Learning Sounding gestures
نویسندگان
چکیده
Non-visual senses can be used in toys to enhance and enrich the play experience. Previous research has shown that – especially for young children developing sensory-motor skills – exploration and play are two tightly linked activities: everything is new and needs to be “studied”, and playful behaviors emerge from active exploration. The main idea of this paper is to provide a new approach in designing and realizing objects that elicit this type of behavior and encourage exploration by providing dynamic, real-time haptic, tactile, auditory feedback depending on a child’s gestures, movements, and emitted sounds. These toys provide interaction based on the enactive para–digm, where multimodal feedback is intimately tied to action – i.e. the human is “in the loop”. Moreover, these musical toys will teach how to perform musical gestures.
منابع مشابه
Sonic Gestures and Rhythmic Interaction between the Human and the Computer
Aalto University, P.O. Box 11000, FI-00076 Aalto www.aalto.fi Author Antti Jylhä Name of the doctoral dissertation Sonic Gestures and Rhythmic Interaction between the Human and the Computer Publisher School of Electrical Engineering Unit Department of Signal Processing and Acoustics Series Aalto University publication series DOCTORAL DISSERTATIONS 32/2012 Field of research Acoustics and audio s...
متن کاملHybrid Motion Control combining Inverse Kinematics and Inverse Dynamics Controllers for Simulating Percussion Gestures
Virtual characters playing virtual musical instruments in a realistic way need to interact in real-time with the simulated sounding environment. Dynamic simulation is a promising approach to finely represent and modulate this interaction. Moreover, capturing human motion provides a database covering a large variety of gestures with different levels of expressivity. We propose in this paper a ne...
متن کاملThe Flo)(ps: Negotiating Between Habitual and Explorative Gestures
The perceived affordances of an everyday object guide its user toward habitual movements and experiences. Physical actions that are not immediately associated with established body techniques often remain neglected. Can sound activate those potentials for action that remain latent in the physicality of an object? How can the exploration of underused and unusual bodily movements be fostered? Thi...
متن کاملReal-Time Simulation and Interaction of Percussion Gestures with Sound Synthesis
Virtual characters playing virtual musical instruments must interact in real-time with the sounding environment. Dynamic simulation is a promising approach to finely represent and modulate this interaction. Moreover, captured human motion can provide a database covering a large variety of gestures with various levels of expressivity. We propose in this paper a physics-based environment in which...
متن کاملA method for measuring the intelligibility and nonnativeness of phone quality in foreign language pronunciation training
The problem addressed is automatically detecting, measuring and correcting nonnative pronunciation characteristics (so-called "for-eign accents") in foreign language speech. Systemic, structural and realizational differences between L1 (native language) and L2 (target language) appear as phone insertions, deletions and substitutions. A bilingual phone recognizer using native-trained acoustic mo...
متن کامل